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Abstract 


Let  [X^.}  be  a  Gaussian  ARMA  process  with  spectral  density 
fg(\),  where  8  is  an  unknown  parameter.  To  estimate  8  we  propose 
a  minimum  contrast  estimation  method  which  includes  the  maximum 
likelihood  method  and  the  quasi-masimum  likelihood  method  as 

A 

special  cases.  Let  8^  be  the  minimum  contrast  estimator  of  8. 
Then  we  derive  the  Edgeworth  expansion  of  the  distribution  of  0T 
up  to  third  order,  and  prove  its  validity.  By  this  Edgeworth 
expansion  we  can  see  that  this  minimum  contrast  estimator  is 
always  second-order  asymptotically  efficient  in  the  class  of 
second-order  asymptotically  median  unbiased  estimators.  Also 
the  third-order  asymptotic  comparisons  among  minimum  contrast 
estimators  will  be  discussed. 


2 


r 


j! 

’/  1.  Introduction 

I 

I'  .  Recently  some  systematic  studies  of  higher  order  asymptotic 

i  theory  for  stationary  processes  have  been  developed.  In  many 

|  cases  such  studies  have  used  the  formal  Edgeworth  expansions, 

r  Thus  it  has  been  required  to  prove  their  validities.  Gotze  and 

■;  Hipp  (1983)  showed  that  formal  Edgeworth  expansions  are  valid 

for  sums  of  weakly  dependent  vectors.  Durbin  (1980)  and  Tani- 
.*  guchi  (1984)  showed  the  validity  of  Edgeworth  expansions  of  sta- 

tistics  derived  from  observations  which  are  not  necessarily  in- 
|  dependent  and  identically  distributed.  However  their  sufficient 

conditions  for  the  validity  are  hard  to  check  even  in  the  funda¬ 


mental  statistics. 

In  this  paper  we  propose  a  minimum  contrast  estimation  method 
which  includes  the  maximum  likelihood  method  and  the  quasi-maximum 


likelihood  method  as  special  cases.  Suppose  that  fx^}  is  a  Gauss¬ 


ian  ARMA  process  with  spectral  density  fQ(X),  where  9  is  an  un¬ 


known  parameter.  Let  9T  be  the  minimum  contrast  estimator  of  9. 


Then  we  give  the  Edgeworth  expansion  of  the  distribution  of  9T  up 


to  third  order,  and  prove  its  validity.  That  is,  as  special  cases 

we  get  the  valid  Edgeworth  expansions  for  the  maximum  likelihood 

estimator  and  the  quasi-maximum  likelihood  estimator  which  is  de- 

i»,T 

fined  by  the  value  minimizing  J^flog  fg(X)  +  I  ( X )/f g (  X ) } dX  with 
rwspect  to  9,  where  Irp(X)  is  the  periodogram. 


In  Section  7  we  consider  the  transformed  statistic  9  = 

m 


9t  +  im(§T),  where  m(  • )  is  a  smooth  function.  Then  we  give  the 


valid  Edgeworth  expansion  for  9^.  By  this  Edgeworth  expansion 


we  can  see  that  our  minimum  contrast  estimator  is  always  second- 
order  asymptotically  efficient  in  the  class  of  second  order 
asymptotically  median  unbiased  estimators  if  efficiency  is  mea¬ 
sured  by  the  degree  of  concentration  of  the  sampling  distribu¬ 
tion  up  to  second  order.  Also  the  third-order  asymptotic  com¬ 
parisons  among  minimum  contrast  estimators  will  be  given. 


2.  Minimum  Contrast  Eastimator 


We  propose  a  minimum  contrast  estimator  which  includes  the 
maximum  likelihood  estimator  and  the  quasi-maximum  likelihood 
estimator  as  special  cases. 

Let  and  be  spaces  of  functions  on  [-TT,rr]  defined 

by 

eo 

D,  =  (f:  f(X)  =  £  a (u)exp (-iuX ) ,  a(u)  =  a(-u), 

a  u=-  «° 


£  (l+|u|)|a(u)|<d,  for  some  d  <  «} , 

u=-« 


D 


ARMA 


if:  f(X)  =  ct  __ 
2£|  P 


£  a.e 
j=o  J 


ijX  i 


,  (ct  >  0), 


£  b,eiJX 
J-o  J 


•2 


q 

£  a.z^' 

J=o  J 


P 

£  b  .z^' 
3=0  J 


<  c,  for  |z |  <  1, 


0  <  c  <  £  <  «}. 

We  set  down  the  following  assumptions. 

Assumption  1.  {X^}  is  a  Gaussian  stationary  process  with  the 

c  1 

spectral  density  fQ  (X)  e  D ARMA>  0Q  e  C  c  9  c  ]R  ,  and  mean  0. 

0  1 

Here  0  is  an  open  set  of  ]R  and  C  is  a  compact  subset  of  9. 

Assumption  2.  The  spectral  density  fg(X)  is  continuously  five 
times  differentiable  with  respect  to  9  e  Q,  and  the  derivatives 


5 


afg/as,  a2f0/aa2,  a3f0/ae3,  a4f0/ae4  and  a5f0/ae5  belong  to  d,. 
Assumption  3  •  There  exists  >  0  such  that 

1(9)  =  -^  J  log  f0(X)}2dX  >  dx  >  0,  for  all  9  in  Q. 

—  TT 

Suppose  that  a  stretch  XT  =  (XX,***,XT)’  of  the  series  f X t } 

is  available.  Let  Z^  =  Z^(8q)  be  the  covariance  matrix  of  X^,. 

The  (m,n)th  element  of  is  given  by  J*_TTexpfi(m-n)\}f0  (X)dX. 

o 

Let  At(8)  and  BT(8)  be  TxT-Toeplitz  matrices  associated  with 

harmonic  functions  gg(X)  and  h0(X),  where  g0  e  darma*  h9  €  Dd 

(i.e.,  the  (m,n)th  element  of  AT(8)  and  B  (8)  are  given  by 

-tt  1  1 

c_TTexp(i(m-n)X}g0(X)dX  and  .^exp (i (m-n  ) X}h0  (  X )dX ,  respectively. 

We  impose  the  following  assumptions. 

Assumption  4.  The  functions  g0  and  h0  are  continuously  four  times 
differentiable  with  respect  to  8  e  0,  and  the  derivatives  dg0/d8, 
...,  a  g0/98  ,  ah0/38,  ...,  a  h0/38  ,  8  e  0,  belong  to  Dd-  Also 
g0  and  h0  satisfy 


Sfl(x)  2he(x)  ~  k  fe(x)  2  y?  f e ( x ) • 


(2.1) 


Assumption  5«  A  function  bT(8)  is  four  times  continuously  diff¬ 
erentiable  with  respect  to  8,  and  is  written  as 

bT(9)  =  ife  J  fe(x)  1  fe^x)dx  +  °(T 

—  TT 


Now  consider  the  following  equation; 


A  X^AT(9)_13  (9)Am(9)_1^rr  =  brp(8),  9  e  Q. 


2. 2  'i 


.* 


\  \  V  V  *.  A  A 


A  minimum  contrast  estimator  9T  of  8o  is  defined  by  a  value  of  9 

A 

that  satisfies  the  equation  (2.2).  This  estimator  8T  includes 
the  following  cases; 

Example  1.  Put  gg  =  fg>  hg  =  5fg/S8  and  b^,(8)  =  ^-|;tr2^^‘-g-g-(Z](p) 
then  by  Theorem  1  in  Taniguchi  (1983) 

bT<9)  -T&  f  ffl'1  A  f0  dX  + 


The  estimator  8T  becomes  the  maximum  likelihood  estimator  (see 
Taniguchi  (1983)  or  (1985)). 


3  f 


l£amPle  g-  Put  80  =  h<  h8  -  A  TT  tf2  ana 

Cm 


bT(9)  =  7^  j*  1  ^  fe  Then  (2.2)  is  written  as 

—  TT 


n 


\ 


X’ 


m 


Qtt  T 


1 


ft  -1 

J-tt  9 


8  31  f8  dX‘ 


(2.3) 


We  can  see  that  the  equation  (2.3)  is  equivalent  to 

S  j*^  Irn  (  X  ) 

Tff  J  ^loS  fgU)  +  Y  ! x  =  0, 

-  TT  9  '  ' 

1  T  it*  2 

where  IT(X)  =  |  EX|.e  4 1  .  Thus  the  estimator  0T  becomes 

t  “1 

the  quasi-maximum  likelihood  estimator  (see  Dunsmuir  and  Hannan 
(1976),  Hosoya  and  Taniguchi ( 1982 )) . 

At  first  we  present  the  following  basic  theorem  which  is 


useful  for  the  higher-order  asymptotic  theory  up  to  third  order 
in  time  series  analysis. 

Theorem  1.  Assume  that  Assumptions  1-5  hold.  Let  a  be  an  arbi¬ 
trary  fixed  number  such  that  0  <  a  <  3/8. 

A 

(1)  There  exists  a  statistic  0^  which  solves  (2.2)  such  that  for 
some  d^  >  0, 

Pq  [(0t-9oI  <  d^-172]  =  1  -  o(T_1),  (2.4-) 

o 

uniformly  for  0Q  e  C. 

(2)  For  { 9,p)  satisfying  (2.4), 

sup  |p£  [ { TI ( 9  ) } 1/2 ( 0m- 9  )  e  B] 

Be®  o 
o 

-  f  0(x )p?(x)dx |  =  o(T-1),  (2.5) 

“B  3 

uniformly  for  0Q  e  C,  where  ®Q  is  a  class  of  Borel  sets  of 
satisfying 

sup  f  „  /(x)pJ(x)dx  =  0(e).  (2.6) 

B €®0  °(SB)e  3 

Here  0(x)  = -L-  e-*2/2,  and  pLx)  =  1  +  Sli)  +  XM  whsre 
,/2n  *  ,/T  1 

and  r(x)  are  polynomials. 

In  Section  6  we  shall  give  the  coefficients  of  q(x)  and  rfx' 
by  using  the  spectral  density  f«. 


3.  Stochastic  expansion  of  minimum  contrast  estimator. 


In  this  section  we  derive  a  stochastic  expansion  of  0  . 

We  set  down 

iT(0)  =  X^Ht(9)}^  -  TbT(0), 

where  HT(0)  =  AT( 9 )_1BT( 9 )A?( 0 )-1. 

Let 

zl(9)  =^^hT(9)^  ‘  TM9)]>  (3> 1 ) 

z2(0)  =  ‘  tr  ^r(9)HT(9)},  (3.2) 

z3  (  9  )  =  ^^T(0)Sr  -  tr  Z^(0)Ht(9)},  (3.3) 


where  HT(0)  =  yg-  HT(0)  and  H*t(9)  =  HT(0).  Henceforth,  for 

5  9 


simplicity,  we  sometimes  use  A,  B,  H,  T.,  Z^,  Zg  and  Z^  instead  of 
At(0),  3t(0),  Ht(0),  St(9),  71(0),  Zg(9)  and  Z^(9),  respectively. 
It  is  easy  to  show  that 


H  =  -  A  1AA_1BA"1  -  A  1BA"1AA“1 


-1*  -1 

+  A  3A  x. 


(3.M 


••  _ i •  _ i •  _ i  _ i  _ i •  _ i *  _ i 

H  =  A  AA  AA  BA  +  A  BA  AA  AA 

- 1  -  - 1  -1  _ l _ l  _ l •  - 1 *  _ ] 

-  A  AA  BA  -  A  BA  AA  +  A  AA  AA  BA 

-1  -1*  -1*  -1  -1*  -1*  -1  -1*  -1*  -1 

+  A  BA  AA  AA  -  A  AA  BA  -  A  BA  AA 


-1*  -1  -1*  -1  -1*  -1*  -1  -1*  -1*  - 

+  2A  AA  BA  AA  -  A  AA  BA  -  A  BA  "AA 


9 


Since  the  minimum  contrast  estimator  is  approximated  by  simple 
functions  of  Z^,  Zg  and  Zy  To  give  the  asymptotic  expansion, 
we  must  evaluate  the  asymptotic  cumular.ts  (moments)  of  Z^,  Z2 
and  Zy  The  following  lemma  is  useful  to  evaluate  them  (see 
Taniguchi  (19^3 )). 


LEMMA  1.  Suppose  that  f^X), — , f g ( X )  e  ,  g^( X ) , . . . ,g  ( X  )  e 
DARMA"  We  def^ne  r^,...,r  ,  A^,...,A  ,  the  TxT-Toeplitz  type 

matrices  associated  with  f, ( X ),..., f  ( X ) ,  g,(X),...,g  (X),  re- 

X  S  X  s 

spectively.  Then 


T"1  tr  ^Aj^TgAg1. 


1 


J  f1(X)...fs(X)g1(X) 


-1 


-TT 


gs(X)_1dX 


-1 


+  0 (T  ). 


We  write 

E  Z,(0)  =  Hill  +  ofT'1)-  (3.6) 

Jr 

Here  u(0)  will  be  evaluated  explicity  for  some  cases  in  Section  7. 
Using  Lemma  1  and  (2.1),  it  is  not  difficult  to  show  the  following 
lemma. 

LEMMA  2.  Under  Assumptions  1-3,  we  have 

E0(Z1(0)}2  =  1(0)  +  0( T- 1 ) ,  (3.7) 

E0fZ1(0)Z2(0)}  =  J(0)  +  0(T-1 ) ,  (3.8) 

Eg(Z1(0)}3  =—  K(0)  +  J_i(0)u(0)  +  0(T~3/2),  (3*9) 


EefZ2(9)}2  =  M(0)  +  0(T_1), 


(3.11) 


E0{Z  (0)2Z  (0)}  =  -^N(0)  +  -Lj(0)u(0)  +  0(T-3/2),  (3.12) 

H  1  d  JT  Jr 

cum0fZ1(0),Z1(0),Z1(9).Z1(0)}  =^H(0)  +  0(T~2),  (3-13) 

E0fT  =  •  J^9)  +  (3.1*) 

Egf^-^iT(9)}  =  -  3J(0)  -  K(0)  +  0  ( T~ 1 ) ,  (3.15) 

w  1  1 


g  fi  JL 
9  T  a03  ~T 


im(0)}  =  -  *L(0)  -  3M(0)  -  6n(0)  -  H( 0 ) 


+  oer'1). 


(3.16) 


where 


J(0)  = 

- 1  r 

(X))3 

f9(^) 

'3dX 

+ 

TS.f 

-TT 

f^fS 

( X ) }  r- 

^^•f0(X)}fg(X)  2dX 

K(0) 

-  5fT. 

3 

a> 

(X))3 

fe(*> 

"3dX, 

°°|w 

ii 

f  ^ 

flfX))1* 

f8(X> 

’4dX 

■  dkf  ^f0^)}2f- 

-  TT 

-TT 

+ 

1  r 

4tt  J 

—  n 

-Af9 

(*)H- 

^■fg(X)}f0(X)  2dX 

M<9)  -ij  -  ij 

-n  -tt  50 


+  in?!  ^7T?fe(x)^  fe(x)~  dx> 


-TT  $)9 


n(s)  -  -  -|j  ^fe(x)^f0(x)  4dX  +  2nJ  ^fe(x)}2^^f0(x)}fe(x)  3dX 

-TT  -TT  5  6 


H(9)  ~  ^?j  ^f0(X)^f0(X)'1+dX- 


-4 


-TT 


B  rp  A  2^  ^2.^2  •  •  •  ^  i^s  *  where  *  •  •  •  *  *  *  ,^s 


TxT-Toeplitz  type  matrices  associated  with  some  harmonic  functions 

Uq  ^(x)  6  •••»  ue  ^(x)  €  Dd»  v0^(x)  €  darma*  **’’  V0S^X^  6 


darma’  resPectlvely* 


LEMMA  3 •  Under  Assumption  1,  for  every  8  >  0,  and  some  d2  >  0, 


we  have 


-  E9(X^BTXT)  |  >  d2TB]  =  ofT'1),  (3. IT) 


^ 1  =  ^  < T'~-X  ’ 


Vt 


uniformly  for  8  e  0. 

[PROOF]  Choose  an  integer  n  >  1  so  that  2r8  >  1.  By  Tchebychev's 
inequality,  we  have 

>  d2TB] 

<  EeCS^B^  -  Ee(}y3rxT)]2l1/(d2Ts)211.  (3.18) 

Since  EgfX^.pXq,  -  Eg(X^BT^T)]2ri  =  0(1)  (see  Lemma  4  of  Taniguchi 
(1985)),  (3.18)  implies  (3-17).  o 


LEMMA  4.  Let  Y_  be  a  random  variable  which  has  the  stochastic 


expansion 


YT  =  y^,3)  +  t-3/%. 


(3.19) 


where  the  distribution  of  Y^r  has  the  following  Edgeworth 


expansion : 


PfY^  e  B]  =  /„0(x)p^(x)dx  +  o(T_1), 


(3.20) 


where  B  is  a  Borel  set  of  ]R^  satisfying  (2.6).  Also  satisfies 


P(  kTl  >  PrjjT)  =  o  ( T~ 1 ) , 


(3.21) 


where  p„  -  0,  p  Tx/  -•  «  as  T  -  Then 


P(Yt  e  B] 


=  ^B0(x)p^(x)dx  +  o(T_1 ) , 


(3.22) 


for  B  e  ®Q. 


The  above  proof  proceeds  on  a  similar  way  to  Chibisov  (1972). 
PROOF  OF  (1)  IN  THEOREM  1. 

In  this  proof  we  develop  the  discussion  by  using  the  argument 
similar  to  that  of  Bhattacharya  and  Ghosh  (1978)  and  Taniguchi  (1985) 
Consider  the  equation 

0  =  T-\(80)  +  T-V-0o)  ^T(0O) 

+  (2T)_1(  e- S0)S  -^T(So) 

S  9 

+  (STrV-e  }3  irUL ) 


0  g  g3  T'  0 ' 


+  Rrr(9), 


(3.23 


where  R^,(9)  is  the  usual  remainder  in  the  Taylor  expansion,  for 
which  it  holds  that 

lpT(®)l  —  27t19-9o^i  slfP  i 

1  " 1  °  at_a  ✓  a_a  * 


,(6’  )  |.  (3.24) 


In  view  of  Lemma  3 >  we  can  see  that  for  every  a  >  0  there  exist 
positive  constants  d^  and  d4  such  that 

pe  [|Z;l(0o)I  >  doTa]  =  o(T-1 ) ,  (3.23) 

o  J 

pe  Nz2(9  )|  >  d3Tal  =  °(T_1)>  (3-26) 

o  J 

P0  £  |Z3(©0) I  >  d3Ta]  =  o(T_1),  (3.27) 

P9  [H^4v9o)  “  E0  -^W90)}l  >  d3Tal  -  ^(T'1),  (3.28) 
o  a9d  T  °  Ho  aed  1  °  6 

p0  C|HT(9)|  >  |0-9o|4(d4Ta}]  =  °(T-1) .  (3.29) 

o 

T  —  I 

Therefore,  on  a  set  having  Pfl  -probability  at  least  1  -  o(T  ), 

So 

for  some  constants  d^  >  0  and  dg  >  0  we  can  rewrite  (3-23)  as 

9-9o  =  (I(0o)+^t)"1[5t+£2T)'1£0-9o)2  ^T(9o) 

9  0 

+  (6t)-1(S-80)3  -^«t(80)  +  <s5 1 8-e0 1  CT]  ,  (3.30) 

a  9 

where  and  6^  are  random  variables  whose  absolute  values  are  less 

than  d^T”^/^1  and  Cm  is  a  random  variable  whose  absolute  value  is 

o  b  T 

less  than  d4Ta.  There  exist  a  sufficiently  large  d^  >  0  and  an 
integer  T  such  that  if  T  >  L  and  [8-0  I  <  d7T  _^2+a,  f  0<a<  3/8 , 


the  right-hand  side  of  (3-30)  is  less  than  djT~x/  .  Applying 
the  Brouwer  fixed  point  theorem  to  the  right-hand  side  of  (3-30) 
we  have  proved  (2.4).  □ 


Now  we  set  down 

VT  =  7t(0t-0o), 

it(9)  =  -  ^Eef^iT(e)) 


^t(8)  f?J{ 8 )+Kf  8 ) }  2 

+  7^^fZl(e)Z2(e)S  +  |Zl(8)S<8)  +  3f~3a)(^K(8))Zl(S)%(8) 

+  C3J(8)+K^8))2:z  (e)3  _  4l(8)+3M(9)+6n(8)+h(8)z  (0)3}> 

21(8)  ^ 


LEMMA  5.  Under  Assumptions  1-5,  we  have  the  following  stochastic 
expansion 

VT(8t-80)  =  Ut(90)  +  T"3/2Ct,  (3.31) 

where  CT  satisfies  P0  (|CT1  >  pAT}  =  o(T-1)  for  some  sequence 

i  o  1  1 

Prp  -  0,  PrjJT  -  »  as  T  -  «B. 

[  PROOF] 

From  the  equation  ^T(8T)  =  0,  we  have 

0  =  Z1(8q)  +  T-1/2Z2(0O)VT  -  It(9q)Vt 

+  |t“3/2[^  (0  )}V2  +  1  [A!]  (0  )}v3 

*  1  °  1  6t^  ae3  1  0  T 

+  — '3*32- 
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SS 


where  1 9  -0Q|  <  |  ®T“e0 1  -■  We  rewrite  (3-32)  as 


Zl(0o)  1  1  O 

Tt  =  +  +  i^^yfT  ^mK 

+  sdr,?1* ^(S°,,VT +  s4i  (9 jtvt^ i^))vr  (3-33) 


'T'-  O' 


Noting  (2.4),  (3. 25 )- (3 • 29 )  with  0  <  a  <  ^/10,  we  can  write  (3.33) 
as 

aT(  1 ) 


Z1 

VT  =  yi  + 
1  XT 


(3.34) 


where  Pg  [ |aT(l) |  >  dgT2a]  =  o(T_1),  for  some  dg  >  0.  Substituting 


n-1 


(3-34)  for  the  right-hand  side  of  (3-33),  and  noting  (3.15)  we  have 


_  Z1  Z1Z2  3J+K  r,2  ,  aT(2) 
T  Im  +  ‘  7^3  L1  +  “T 


■T  sPlL  2/TI' 

n3CCn  _  -  /  m”  1  ' 


(3.35) 


where  PQ  [  [aT(2)  j  >  d^T^a]  =  o(T_1),  for  some  d^  >  0.  Again  substi¬ 
tuting  (3.35)  for  the  right-hand  side  of  (3.33),  and  noting  (3.15) 
we  have 

VT  =  W  +  Ct/t372,  (3.36) 


where  PZ  [|CT!  >  d,0T5a]  =  o(T_1),  for  some  d,n  >  0.  Since 


0  L  I  ^  m  I 

O 


'10 


10 


0  <  a  <  1/10,  we  have  the  desired  result. 


REMARK.  3y  Lemma  4,  the  Edgeworth  expansion  for  Vt(0t-9o)  (up  to 


,-l 


order  T  )  is  equal  to  that  for  U^,(0O)  on  5  e  ®  .  Thus  we  have 


only  to  derive  the  Edgeworth  expansion  for  U^(0o) 
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4.  Asymptotic  expansion  of  characteristic  function. 


As  we  saw  in  the  previous  section  we  have  to  seek  the  Edge- 
worth  expansion  for  Urj,(8Q).  To  do  so  we  have  to  derive  the  Edge- 
worth  expansion  for  Z  =  (Z^(9),  Zg(8),  Z^(S))T.  Thus,  in  this 
section,  we  give  an  asymptotic  expansion  of  the  characteristic 
function  of  Z. 


T(t)= 

where  t  =  .  Then  it  is  easy  to  show 

t(t)  =  detfl(TxT)  -  —  r1/2  (txH  +  tgH  +  t^H )  E  } " 1//2 

VT 


x  exp  -  —  (t1TbT(0)  +  t2trHE  +  t3trHE  ), 

*/t 


(4.1) 


where  i(TxT)  is  the  TxT-identity  matrix.  Let  be  the  jth  latent 
root  of  S  =  £1//2  (t1S1  +  t2S2  +  t3S3  )Z1/2  (p2  >  ...  >  p2  >0). 

Of  course  each  p.  is  a  real  number.  Then  we  have 


log  T(t) 


=  -  i  T, 


^  log(l  -  —  pj 
d  .1  =  1  ./T  J 


-  -i-(t^Tb^,(9)  +  tptrHS  +  tptrHD). 


(4.21 


Notice  the  relation 


log(l-ih)  = 


lh  ,  h2  ih3  h4  ih5 

-  ih  +  -j-  +  — -  -jp  -  — 


where 


11(1  -  v)5_^Z -  I  <  ! 

(1  -  ivh)b  “ 

(e.g. ,  Bhattacharya  and  Rao  (1976,  p.57)).  By  (4.3),  the  relation 
(4.2)  is 

i  T  2ip  4p  2  8iP  3 
log  x(t)  =  -  7T  E  [ - i 

l  •  -i  i  A  m  _  »  ■ 


2  j=i  JT  2T  3Tiv/r 
l6p  *  25ip  5  26P<6Yl 


-  -i-(t1TbT(  8  )  +  tgtr-HE  +  tjtrHS  ),  (4.4) 


where  | y j 1  <  1.  Remembering  (3.6),  we  have 


41-3  1 

— — trSJ 


log  t  ( t )  =  it  fHlii  +  o ( T~ 1 ) }  +  iptrS2  +  — — ■ 

7r  1  3TVt 


+  ^i-trS4  +  — *-LtrS5  +  R,-, 


25  6 

where  |Rg|  <  -^trS  .  Using  Lemma  1  we  can  rewrite  as 


(4.5) 


2i2  2 


3 

E  (A 

J,*=l  ' 


+ 

*  m 


^  +  0(T“3/2)} (itj)(itk). 


(4.6) 


^-trS3  =  j  Zn  "  fA1k|l  +  0(T_1)}(it,  )(itkl(itg),  (4.7 


J,M=1 


T  fAjk£m+°(T  )} 


J ,k,a ,m=l 


x  (itjHitk)(itg)(itm) 


3§!l!trs5  = 


.  .?  fAjk‘mn  +  °'T'1>) 
0,k,i,m,n=l  d 


i^trS6  -  T  fAikmnp  +  Of1'1)1 

T  3  ,fc,i  ,m,n,p=l  J  P 


x  (4. 

For  examples  we  can  see  that  A^  =  1(9),  A12  =  j(9),  A^  =  L 

A22  =  M(9),  Am  =  ^(®)*  A112  =  ^  ( ® )  >  Allll  =  e.t.c.. 

Thus  (4.5)  Is  written  as 


log  t(t)  =  it1(tilii  +  o(T_1 ) ) 

7t 


-3/2  ■ 


+  £  ,  l  /Ajk  +  Bjk/T  +  0(T-^")}(it.)(itk) 

,1  1 


+  ^J>A-l{A^  +  0(T'1,,  (iv(lt*)(lt*> 


+  rrr  .  .  5_.  .{Ajkim+  °<T" 


24t  j,i,£,m=l 


T  3  1 

+  - T7p  'P  fA1kftnn  +  °'T  )Hit1Mitk)(it;Hi 

120TJ/^  .1.k_^.m.n=l  d  K 


If  0 


We  set  d  own  0  =  {Ajk) ,  3x3-matrix,  and  I! it  [I  =  ,/t2+t|+t2. 
is  singular  it  is  not  difficult  to  show  that 


=  c2(9)Z3(0)  +  d2(0),  a. s . 

(1  =  1,2),  (4,12) 


which  implies  that  the  joint  distribution  of  z  is  reduced  to  that 
of  Thus,  without  loss  of  generality,  henceforth  we  consider 

the  case  when  Cl  is  nonsingular. 


LEMMA  6.  If  we  take  T  sufficiently  large,  then  for  a  6^  >  0  and 
for  all  t  satisfying  lit!!  <  6^/r,  there  exists  a  positive  definite 
matrix  Qq  and  polynomial  functions  F^(*)  and  F2(*)  such  that 

\r(t)  -  A(t:3)| 

=  exp {-  |  t’Ot}  x  F1(l!t[l)-0(T‘3/2) 

+  exp f-  t'Q0t)  x  F2(!!t!!)*0(T'3/2),  (4.13) 


where 


1  iut, 

A(t:3)  =  exp(-  it'nt]  x  [1  +  - = 


3 

2  A 

j ,k ,&=1 


3  u2(it  )2 


u(it1) 
6  T 


3 

Z  A1kj(it.)(itk)(it,) 

v  /7_i  JK"  J  ^ 


+  55t  .  £=1 

J  f  ^  f  **  f  ^ 


+  72T  •  J.H,  Aj^Aj'k'i«(itjHitk)(it^)(itJ,)(itkI)(iti?I)l 


[PROOF]  From  (4.11)  we  have 

T(t)  =  expf-  it'Ot]  x  expfit.f—  +  o(T-1)] 

2~  ~  1  yr 

+  ^  j,k=iBJk(ltJ)(ltk)  +  ~in 


+  --  r  a  . 

24t  j  ,k,i  ,m=l  J' 


Aj^m(itjHitk)(it^)(itm) 


+  F.(!!t[!)0(T~3/2)], 


(4.14) 


where  F^ ( • )  is  a  polynomial  function.  Applying  the  relation 


'ez  -  1  -  z  -  ill  <  -L5j2e  lz 
z  1  —  6 


(4.15) 


to  the  second  exponential  in  the  right-hand  side  of  (4.14)  we  have 
lT(t)  -  A(t:3)|  =  exp(-  ■^t'Qt}*F1(!!t!!)0(T"3/2) 

+  0(T"3/2)-F4(!!t|!)-exp[-  |t'Ot} 

f  b  _j_  q  /  fp*"  j 

x  expf  [itif-—  +  (T-1)}  +i  F — ^ - - - (it.)(itk) 

1  yr  2  T  J 

+  T  (A.,  *  +  0(T'1)}(it,)(it.  )(it«) 


6./t  jAy 


+  sir  ,  ,Z,  +  0(T-1)}(ltJ)atk){it„)(itm) 

tj  ^  jin 


775 

120T'5/  ^  j  ,k ,  Z7  ,m.,n 


(A 


jki: 


mn 


0(T"1)}(itJ.)(itk 


)  fit 


it 


m 


+  Rg  I  ] » 


(4.16 ) 


where  ( • )  is  a  polynomial  function.  Let  uu  >  0  be  the  smallest 
eigen  value  of  fi.  Then  for  sufficiently  large  T,  we  can  choose 
6^  >  0  so  that 


(JU 

T 


3 

r 

j  j=i 


u, 


jk£ 


24 


3 

r  |  A 

j  ,k  ,  ?  ,m=l  J^m 


3 


120  j,k5,m,nlAJkto 


3 

r 


2^&l  .  v  F  ^Jk/’mnp 

j  ,k  ,  •  ,m  ,n  ,p=l 


>  0. 


( 4 . 17 ' 


Thus  the  last  exponential  term  in  (4.16)  is  dominated  by 
expf^fu  +  o(T'l/2  )}]  exp  [  !!t!! 2  f|  +  0(T_1)}], 

for  !!t!!  £  6r/T,  r  4 .  IS 

which  implies  the  existence  of  Q  in  (4.13b  □ 

We  also  have  the  following  lemma. 


LEMMA  7.  Under  Assumptions  1-5,  for  every  ^  >  0,  there  exists 
fig  >  0  such  that 

!T(til  <  (1  +  4  62r  '“qi  - ,//u , 

for  all  t  satisfying  !! tj-  >  n/F,  where  a(T'  =  [cT],  for  seme 


it 


constant  c. 


Notice  that  pn  =  max  eTS  e,  where  e  =  (e-.  , . .  •  ,e_) T  e  3? 

x  0  ^  **  l  i 

** 

and  e'e  =1.  Also  we  have 

e'S2e  =  e'[E1//2(t1H  +  tg&  +  t^E)^2}2^ 

<  2t?e  '^hShE1^  +  2t2e’E1//2HZ'Hi:1//2e 


+  2t?e»£1/2H  SH  s1/2e.  (4.20' 

It  is  not  difficult  to  show  that 

e,rL//2HEHE1//2e  <  c,  ,  (4.21) 

e'^HEHE^e  <  Cg,  (4.22^ 

e 'ZP'^hD H*S  1//2e  <  c^,  (4.23^ 


where  c^,  and  are  some  positive  constants.  For  exposition 
we  prove  (4.21).  Since  f0(X),  h0(X)  e  and  g0  e  ^Rm,  we  can 
set 


f,  =  max  f  (  X  )  < 

x  X  * 

h-,  =  max  |  hp  ( X  )  j  <  «, 
1  X  a 

S1  =  min  g9( X)  >  0. 
X 


Thus , 


using 

e 


discussions  of  Anderson  (1971,  p.573-4)  we  have 
f/2HZHZ:1/2e  =  e'^A-^A-^A^BA-^e 


© 


A  13A"1r1^2! 


<  e'Z^A-hA-1 


=  2TTf  e  fE1//2A“  ^A'  1,/2a"  XA“  ^BA- 

/  2-rg,  ®  \  “1 

<  2rrfleJ^A-hA-l/2  (  \  A-^BA-^e 

V  ©  2 TTgl  / 

=  £l  e'^A^A-V-^s 

S]_  ~  ~ 

<  £l  e'^A-^^BB^A-^e 

—  r.  C.  ++  ** 

2TTgx 


< 


2"flh? 

2 

Si 


'E^VV^ 


.2.  2  .2.2 

flhl  f1hl 

si  gi 


(4.24) 


Thus  we  have  proved  (4.21).  The  proofs  of  (4.22)  and  (4.23)  are 
similar.  From  (4.20)  we  have 

p2  <  ...  <  p2  <  lit  If2  •d11  (4.25) 


for  any  t,  where  d^  is  a  positive  constant.  While  by  Lemma  1, 
we  get 

T"1  E  p2  =  T_1trS2 
3=1  J 

nrr 

=  £  j  C txA ( \ )  +  tgB ( x )  +  t  c(\)}2d\  +  !!t!!2o(T_1) 

— >  ■’T 


(■ 


txA(X)  +  tgB(\)  +  t3C(\) 


2 

}  dX 


+  I!t!!2o(T_1) , 


(4.26") 


where  A(  * )  =  5  prf  9(  * ) -f  e{  * )  , 

B(X)  =  |C-2f6(\)-2(^f9(M)2  +  fe(X)-1-^f9(X)), 

5  9 

and 

C(\)  =  f6fg(X)  ^(-^g-f’g(X)  -  6fg(\)  2yg.fQ(\).-^.fe(X) 

5  9 

ZB5  w 

Since  we  are  now  assuming  that  0  in  (4.11)  is  nonsingular,  the 

functions  A(X),  B(X)  and  C(X)  are  linearly  independent  in  the 
,n  2 

L2~norm  (J  | • |  dX).  So  we  can  show  that  for  sufficiently  large  T 
there  exists  d^2  >  0  such  that 

T 

t'1  S  p2  >  [|tl!2als,  (4.27) 

J 


for  any  t.  The  relations  (4.25)  and  (4.27)  imply  that  there  exist 
&2  >  0  and  q(t)  =  [ cT]  such  that 


P1  -  •  •  *  -  pq(T)  -  M&R2, 


Noting  that 


T 


: r(t) i  =  n  (i  +  i  p2) 


4  .2 ,-1/4 


j=l 


<  q^T'  2  -l/4 

5  j=i  +  M2> 


<  (I  +  462t,)-^(t)/4,  for  ||£|!  >  n/t. 


the  proof  is  completed. 


a 


5.  Edgeworth  expansion  for  Z 

In  this  section  we  shall  give  the  Edgeworth  expansion  for  Z. 
We  set  down  B(x.r)  =  {  z  e  BP:  \\z  -  xlf  <  r,  x  c  BP)  .  For  a  proba 
bility  measure  P,  we  denote  the  variation  norm  of  P  by  [fp[f.  The 
following  lemma  is  known  as  a  smoothing  lemma  (see  Bhattacharya 
and  Rao  (1976,  p.97-98  and  p.113)). 


LEMMA  8.  Let  P  and  Q  be  probability  measures  on  BP  and  the 
class  of  all  Borel  subsets  of  Bp.  Let  e  be  a  positive  number. 
Then  there  exists  a  kernel  probability  measure  Kg  such  that 


sup  | P(B  )  -  Q(B)  | 

Be*P 

<  |if(P  -  Q)*Kcll  +  ^  sup  Q  f  (SB  )2e}  , 

B  e(PP 


where  Kg  satisfies 


Kg(B(0,r)c)  =  0((|)  ), 


(5.1) 


(5.2) 


and  the  Fourier  transform  Kg  satisfies 

Kg  ( t )  =  0  for  ||t  I!  >  8pii^3/rT1//5e- 


For  B 


define 


q|3)(B)  =  4  N(z:n)[l  +  —  H,(z) 
-  ,/T 


,  Ajk.2Hjk^O  +  £tH11(£ 


6,/r  j  ,k,2=i 


a 


+ 


(5.3) 


+  ^  j,k=lBjkHjk(~}  +  ^  j,k^=lUAjkiHlJki(5') 


22|T  m=l 


+  755  j,k(i,?;k;r.iA^Aj,kU'H^'k,r(~)]' 

where  z  =  (z-^z^z,) 1 , 

N(z:Q)  =  (2TT)‘3/2|nrl/2exp-i  z’n_1z. 


Hj  ••*3  (£)  =  ~^1)S  * 
J1  “ s  N(z :fi) 


N(z:Q)  Sz  .  . . . Sz  . 


N(z:fi). 


This  measure  Q^.  ^3  ^  ( • )  corresponds  to  the  characteristic  function 
A(t:3)  in  Lemma  6.  Then  we  have  the  following  lemma. 

LEMMA  9.  Suppose  that  Assumptions  1-5  are  satisfied.  Then 

sup  |  Pq  (Z  €  B}  -  Q.i  3  \  B  )  |  =  o(T'1) 


B  €03“ 


+  4  sup  0^3)f(5B)2e}, 

a3  * 


(5.4) 


Beffl- 


uniformly  for  9  e  6,  where  e=T^P,  0<p<  1/2. 


'  r>  \ 


[PROOF]  Substituting  PgfZ  e  B]  and  for  F(3)  a: 

Lemma  8,  respectively,  we  get 


-3  ^  /  R>  )  4  , 

!»-«.  O'-  u-  i 


sup  lp©rz  €  B}  -  '  (B )  | 

Be*3 

<  |l!(pj  -  q|3))*k£1! 

+  J  sup  Qp^f(aB)2e}.  (5.5) 

Be*3  ~ 

Notice  that 

!l(Pg  -  Q^3))*Ke!l 

=  2  sup(|(Pg  -  3  ^ )  *Kg  ( B  )  | ;  B  e  fB3} 

<2  supf  |(pj  -  Qp))^Kg(B)  |;  B  e  fP3  and  B  c  B(0,rT)} 

+  2  supf \(p]  -  <43))*Ke(B)  I;  B  e  rti3  and  B  C  B(0,r_)c}, 

(5.6) 

where  r^,  =  Tt,  0  <  t  <  l/£.  Here  we  put  £  =  T~‘I"_P,  0  <  p  <  1/2. 
Then,  for  B  c  B(0,r,p)C  we  have 

I(Pq  "  Qp))^Kg(B)|  <  |PJ*KC(B)|  +  |Qp^Ke(B)| 

/ 

<  Pq(!!zI!  >  r^/2)  +  Ke(B(0,rT/2)C} 

+  Q^3)fB(0,rT/2)C)  +  Kg(3(0,rT/2)C}.  (5.7) 


It  is  easy  to  check 


s43)fB(0,rV2)}  =  o  (T- 1 ). 


(5.8) 


The  relations  (3.25),  (3.26)  and  (3.27)  imply 


P@(  Hz!!  >  rT/2)  =  o(T_1) .  (5.9) 

While  (5.2)  implies 

Ke(3(0,rT/2)c]  =  0(t“3_3p_3t)  =  o(T_1).  (5.10) 

Thus  we  have 

I(Pq  -  Q^3 } (b )  I  =  0 ( 1 ) »  (5.H) 

for  B  c  B(0,r^,)c.  Now  we  have  only  to  evaluate 
sup [ | ( Pg  -  3  ^ ) *Kg ( 3 ) j ;  B  c  B(0,rT)}. 


By  Fourier  inversion  we  have 

Kp0  -  Q^3))*Kg(B)| 

3  /2  r3 

-  (a"r3  "3  .3 7  X 1  ( P?  -  Qp’xtXeftjldt.  (5.12) 

^F(^) 

By  Lemma  6  and  noting  A(t:3),  the  right-hand  side  of  (5. 12 'i 

is  dominated  by 

0(t3t-3/2)  .  | exp {-  4ir0t]  x  F1(!!t||) 

J!!t[!<6r/T 


+  expf-t'Qot}  x  F2(!!t!l)  !  I  Kg  ( t )  |  dt 


+ 


0(T3t)J 


6r/T<l!t!!<  8(3) 


^/3ti+P/, 


1/3 


f  p1 


Ut 


dt. 


Evidently  the  first  term  of  the  above  is  of  order  0(T~  /J3).  Als 
by  Lemma  7,  we  have 


0(T3T)J6l^<llt,!<8(3,V3Tl+P/„l/3|(^  - 


<  0(T3t)J 


6 1-/T  <  II  t  [!j<d  1 4  T 


<0,(1  +  46261) 


1+p  13 


6,  )-q(T)Adt  +  o ( T~ 1 ) , 


(5.1*0 


where  d^  and  d^  are  appropriate  positive  constants. 
(5.1*0  is  dominated  by 


The  above 


0(T3t+3+3p  )  (1  +  46261)_<3^T^4  +  o ( T~ 1 )  =  o ( T~ 1 ) .  (5-15 


Therefore  we  have  proved 

sup(  |  ( Pg  -  Qp))*Kc(B)|s  B  C  B(0,rT))  =  o(T_1), 

which  completes  the  proof.  n 


UI  4.1 
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$.  Proof  for  (2)  of  Theorem  1. 

Consider  the  following  transformation 

W1(9)  =  Z1(fl) 

W2(0)  =  Z2(0)  -  J(0)I(8)'1Z1(e), 

W3(0)  =Z3(0)  -  L(0)I(0)"1Z1(0).  (6.1) 


Henceforth,  for  simplicity  we  sometimes  use  W1,  W2  and  W- ,  instead 
of  W1(0),  Wg(8)  and  ( 0 ) ,  respectively.  Evidently  (6.1)  is  a 
continuous  bijective  transformation.  We  denote  (6.1)  by  W  =  x(Z), 
where  W  =  (W^Wg,*^)'.  By  Lemma  9,  we  have 

sup  1 Pq TZ  e  X"1(B))  -  Q^3) f X_1(B ) }  | 

Be®3 


=  i  sup  43)C fax_1(B)}2S]  +  o ( T~ 1 ) . 


Be®' 


z 

D  ~ 


(6.2) 


Here  we  put  ftO)(B)  =  q|3  )  ) ) .  Then  it  is  not  difficult  to 


show 


43)(B)  =  J  N(w1:I)N(w2,w3:Q2)[1  + 

~  B 


3  o'1)  .  3 


T.  -j —  H,(w)  +  -i-  t  c(iiH.w.iw) 
J=1  7t  J  -  67t  J,k,«=i  ~ 


+  -L  .  s  .(cj-k}  +  ci1)ck1})Hik(2' 


3T  3 ,k=l 


\Jk' 


+  -i-  V'  l(W'1 

^  J,k,?,m=l  J  k4m‘JkAn<~' 


24T  j,M,"=iCjWmHjka”<i!> 

-i-  £  c(l)  e(l)  H  ,  , 

72T  J,k,<J!k!f=l  cj'k'rHjk«3'k,«'(K) 


=  J  QT(w)dw,  say, 

B 


(6.3) 


w? 


21 


where  w  =  (w1,wg, w^ ) 1 ,  N(w1:I)  =  (2n)"1//2i_1//2exp  - 
and  N(w2,w3:n2)  =  (2TT)’1  j  n2  !‘1/2exp  -  |(w2,i»3  )o;1(^2 ) , 

=  /°22n23 \ 

2  ^  n^2n 33  2x2-matrix. 


For  examples  we  can  see 

cj1)  =  h(0),  c^1)  =  -J(0)n(9)/l(0),  c^1)  =  -L( 0 )u( 0 )/l( 0 ) , 

n22  =  M(9)  *  J(8)2I(0)_1,  =  N  ( 9 )  -  J(0)K(0)/I(0), 

Cllll  =  H(0)’  e.t.c.. 


Since  x  is  continuous,  we  have 

3X_1(B)  e  X_1(3B), 

fax_1(B))2e  c  fX"1(SB)}2e.  (6.4) 

By  the  continuity  of  x>  there  exists  a  >  0  such  that 

{x_1(SB))2e  c  x  1f(aB)ae}.  (6.3) 


Thus  we  have 


LEMMA  10.  Under  Assumptions  1-5 


(6.6) 


uniformly  for  0  e  G,  where  a  is  a  positive  constant  and  e  =  T 
0  <  p  <  1/2.  a 


Now  we  rewrite  U^,(  9 )  in  Lemma  5  as 


uT(«) 


*1  WXW2  (J  +  K)W? 

j—  +  —75 -  “  - 3 - 

T  iVF  21 


+  ^/W1W2  +  (-Jg-fJK)W!M8  +  f WfW3 
+  (2jL+_3KJ_+_K^)w3  _  L  -t-  3M  +  6n  4-  H  w3j 

2 12  1  6 1  r 


(6.7) 


Consider  the  following  transformation 


Sx  =  uT(w) 


(6.8 ) 


We  denote  (6.8)  by  S  =  #  (W ) ,  where  £  =  (S-^^S^^S^)’.  For  sufficiently 
large  T,  we  can  take  a  set 

Mt  =  (W:  |W1|  <  c._Ta,  0  <  a  <  1/6,  c±  >  0,  i  =  1,2,3) 
such  that  \lf  is  a  C^-mapping  on  Mm. 


(6.9) 


3y  (6.6), 

sup|Pgf¥  €  *‘1(B  x  JR2)  }  -  Q^3)(-r1(B  x  E2)  }| 
Be®  ~ 


=  i  sup  Qp){(Sr1(B  x  E2))ae}  +  o  (T- 1 ) . 
^  Be®  ~ 


We  can  see  that 


43)f’^1(B  x  B2)  }  =  J*  _ 


J  _i  2 s 
*  (Bx]R  )  1 


n-l< 


=  J  _x  2  +  °(T”  ) 

MTn4f  1(BxEi)  T 


^  {BxE2}nNrpHT 


9tM'_1(s))  I J  leas  +  o  (T-1 ) ,  (6.10 


where  NT  =  *(MT)  and  |j|  Is  the  Jaccobian.  Since  we  can  solve 
so  that 


W1  =  Vl 


S1S2 

■ft 


+ 


(J  +  K)S- 

2-JT 


js2s2 

IT 


flfa 

2T 


(-J2  -  JK)S3 
2IT 


L  +  3M  +  6N  + 

6t 


H  q3 

_bl 


o  ( T~ 1 ) , 


(6.11 


uniformly  on  M^,  it  is  not  difficult  to  show  that 
qTr  •!'"1(S) }  |  J  ! 

o,  ( S  )  ( S  )  . 

=  N(It31)N(S2,S3:02)  x  flT  +  +  o(T-i)}, 

vT 


(6.12 


uniformly  on  Nn,  where  p_,(S)  and  p0(S)  are  polynomials  of  S. 


we  have 


43)(*_1(B  x  ®2)}  =  /  N(I_S1)N(Sg,S,:a> 

~  (Bx]R  }0Nm  11  d  *  d 


x  Clm  + 


Pl(§.)  P2^§.) 


7t 


+ 


n~l 


—  +  o(T~x)}dS  +  o ( T- 1 ) 


(•  •  »  P,  (S)  P0(S) 

-  JNtViltJj  ,  [J-  +  -U-=_  +  -4==-} 


B 


B 


Vt 


x  N(S2,S3:n2)dS2dS3]dS1  +  o(T-1) 


Calculating  the  square  bracket  in  (6.13),  and  noting  that 


Qw3  ^  C ( a ♦  1(B  x  ^;)ar) 


2  ,  ..  ae  . 


T£ 


<  r1f(aB)bfi  x  ]R2}]  ,  for  some  b  >  0, 


we  have 


sup  [  Pg  (VrT(  @T  -  0)  €  B}  -  ]*  ^(x)pT(x)dx[ 


Be® 


i  sup  (*  j2f(x)pJF(x)dx  +  o(T-1) 

JB€®oJ(aB)be  3 


(6 


(remember  (6.9)).  Here 

T 
3 

+  !<t  +  ^)(x2  - 1}  +  <4  +  !sr>(*' 


m  0C-.  X  V-i  o 

P-3  ( x )  =  1  +  —  +  — —  (xb  -  3x) 

^  7t  6VT 


a. 


6x^  +  3  'i 


1_,„6 


7QT 


(x  -  15x  +  ^5x  -  15), 


(6 
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where 


where 


Remembering  (2.6)  we  have  proved  (2)  of  Theorem  1.  More  explicit 
forms  of  (6.15)  tor  the  exact  maximum  likelihood  estimators  are 
given  in  Taniguchi  (1985). 
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7.  Third  order  asymptotic  properties 
of  minimum  contrast  estimators. 

Taniguchi  (1985)  discussed  third  order  asymptotic  prop¬ 
erties  of  maximum  likelihood  estimators  in  the  class  of  third  order 
asymptotically  median  unbiased  (AMU)  estimators,  and  showed  a  cer¬ 
tain  optimality  of  maximum  likelihood  estimators.  Using  the  Edge- 
worth  expansions  of  minimum  contrast  estimators  we  can  discuss 
their  third  order  asymptotic  properties  in  this  class. 

If  an  estimator  ?  satisfies  the  equations 

lim  T^k_1^2  |Pg(^T(8  -  9)  <  0}  -  1/2 1  =  0,  (7.1) 

T-.ec  °  i 

lim  T^k_1)//2|pJ(7T(1'T  -  9)  >  0)  -  1/2  |  =  0,  <1.2  - 

r]]'— ■♦CO 

A* 

then  9t  is  called  kth-order  asymptotically  median  unbiased  :kth- 
order  AMU  for  short).  We  denote  the  set  of  kth-crder  AMU  estimators 

a 

by  A^.  In  general  the  minimum  contrast  estimator  0T  is  net  third 

A 

orde7’  .AMU.  To  be  so  a  modification  of  9^  is  required.  The  follow¬ 
ing  theorem  gi/es  the  validity  of  Edgeworth  expansion  for  modified 

A 

estimators  of  9^. 

THEOREM  2.  Suppose  that  m(0)  is  a  continuously  twice  differentiable 
function.  Define 

®m  =  ®T  +  ^  V* 

Then 

sup  [  Pg[./TT(  6  -  9)  6  B] 

o 

-  J’a^(y)q^3(y)dyl  =  o(t 


•  •  ‘V-j 


uniformly  for  0  e  C,  where 


y 

9.^3 ( y )  =  i  +  ^ai  +  ^m(0)^  y  +  ^rj=(y3  "  3y) 

+  ai  +  2mf(0)  +  Im(8)2  +  2a1yTm(0)}  (y2  -  1) 

"i  oc-»  Y"i  Y  yTm  ( 8 )  2i  o 

+  ff5T  +  -41  +  fc  1  (y  -  6y  +  3) 


V  -I  C  h  p 

+  ^(y  -  I5y  +  45y^  -  15). 


[PROOF] 

Since  m( • )  is  continuously  twice  differentiable,  we  have 
7rT(0m  -  0)  =  7tT(0t  -  9)  +  ^m(8) 

+  /TI  (  0T  -  9)«mY9^-  +  T“3//2[,/TT(8T  -  0  )  }2m'  1  (  0* )/VT, 

(7.4) 

.  A 

where  0  ^  8*  >  0 

By  (1)  of  Theorem  1  we  have 

Pq[[7tT(0t  -  9  )  }2m'  (  8*)/VT  >  T2a]  =  o  ( T- 1 ) ,  (7.5) 

for  0  <  a  <  1/4.  Putting  pT  =  T  7  in  Lemma  4,  we  have  only 
to  derive  the  Edgeworth  expansion  for  a^U^  +  s^,  where  a^  = 

A 

[1  +  m'(9)/T},  UT  =  7tT(0t  -  0)  and  sT  =  v:^m(8).  3y  Theorem  1, 
we  have 

sup  | pT f U  e  B}  -  I  0(x )p?(x )dx  J  =  o ( T-1 ) .  (7.6) 

B  e0Bo  1  B  15 


Lemma  4  implies  that 


(7.7) 


sup  |Pg(VTT(8m  -  8)  €  B)  -  Pj(aTUT  +  sT  €  B)  | 
3  €®0 

=  o(T_1) . 


Also  we  have 


sup  |pT[a  U  +  sm  e  3}  -  I  0(x)pj(x)dx| 

3€«q  a^+s^B  J 

=  °(7-1) .  (7.8) 


Transforming  y  =  a^pc  +  sT,  it  is  not  difficult  to  show 

J  0(x)p^(x)dx  =  J  0(y)qL(y)dy  +  o(T_1).  (7.9) 

a^+s^B  J  B 


The  relations  (7.7),  (7.8)  and  (7-9)  imply  our  assertion.  □ 


For  m(  9 )  =  -  4  ( 0  ).  we  denote  8* 

6l( 0 )2  x(e)  T 

we  have 


In  this  case 


COROLLARY  2. 


sup  |p£cVtT(0t  -  9)  €  B] 

Be®0  9 


0(x)[l  +  ^  +  -^-(x3  _  3x) 


6-Tr  6-7 t 


+  #  - 


1  r2v  ,  A  _  2uJ_  135J2  +  216JK  +  7 OK2 


2T  I 


361 

6 


T 


3L+9N_+2H)(x2  _1)+I^  +  |}(x^_6x2  +  3 


31 


.6 


+  -±-( x rj  -  15xh  +  -  15 )  ]  dx  |  =  o(  T- 1 ) 


(7.10) 


REMARK 


Of  course  0T  belongs  to  Ag,  and  we  can  see  that  the  asymptotic 
distribution  of  0T  (up  to  second  order)  coincides  with  that  of  the 
second  order  efficient  estimator  (see  Taniguchi  (1983)  or  (1985)). 

REMARK 

*  "K" 

It  is  easy  to  check  that  0,_,  is  third  order  AMU.  Also  it  is 
e^  =  2r)  +  A  -  2(u '  that  depends  on  the  minimum  contrast  estimator. 

*  * 

Let  9.(i  =  1,2)  be  the  modified  minimum  contrast  estimators 
with  A^,  r)^  and  m^(i  =  1,2)  in  place  of  u.  A,  r  and  m,  re¬ 

spectively.  Then  we  have 


COROLLARY  3.  For  B  =  (-a, a),  a  >  0, 

lim  T[pT{yrT(0*  -  0)  e  Bj  -  P^TITfe*  -  0)  €  B}] 

T-»«o  ox 

=  i  a0(a)(2(n2  -  t^)  +  ^  -  A]_  +  2(u’  -  u£ ) } ,  (7.11) 

A  -4- 

Thus  if  2ri ^  +  A-^  -  2n^  is  smaller  than  2t-|2  +  A^  -  2u^ ,  then  0^  is 
better  than  02  in  third  order  sense. 

EXAMPLE  3*  Let  Cx^_ }  be  a  Gaussian  autoregressive  process  with  the 
spectral  density 


1x72 


9e 


9 


where  |  0  |  <1. 

■»* 

Let  0^  be  the  modified  maximum  likelihood  estimator  of  0  de- 

*  * 

fined  in  Example  1).  Also  let  9p  be  the  modified  quasi-maximum 


likelihood  estimator  of  8  (defined  in  Example  2).  Then  we 


have 


For  this 


O  _  1 

|j,  =0,  A,  =  — - 7T—0 ,  P,  =  -  A-,  , 

1  1  (1  -  9  2f  1  1 

-  0  -  0^  _  2. 

“2  =  (i  -  e2)’  ^  =  (i  -V)2’  ^  '  °‘ 

case,  the  right-hand  side  of  (7.11)  is  equal  to 

Y  a$(a)  - - — y  —  0j 

1  1  -  8d 


which  coincides  with  the  result  of  Fujikoshi  and  Ochi  (198*0. 
That  is,  91  is  better  than 
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